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Abstract. This paper concerns the consensus of discrete-time multi-agent 
systems with linear or linearized dynamics. An observer-type protocol based 
on the relative outputs of neighboring agents is proposed. The consensus of 
such a multi-agent system with a directed communication topology can be cast 
into the stability of a set of matrices with the same low dimension as that of a 
single agent. The notion of discrete-time consensus region is then introduced 
and analyzed. For neurally stable agents, it is shown that there exists an 
observer-type protocol having a bounded consensus region in the form of an 
open unit disk, provided that each agent is stabilizable and detectable. An 
algorithm is further presented to construct a protocol to achieve consensus 
with respect to all the communication topologies containing a spanning tree. 
Moreover, for unstable agents, an algorithm is proposed to construct a protocol 
having an origin-centered disk of radius 5 (0 < 5 < 1) as its consensus region, 
where S has to further satisfy a constraint related to the unstable eigenvalues of 
a single agent for the case where each agent has a least one eigenvalue outside 
the unit circle. Finally, the consensus algorithms are applied to solve formation 
control problems of multi-agent systems. 



1. Introduction. In recent years, the consensus issue of multi-agent systems has 
received compeUing attention from various scientific communities, for its broad ap- 
phcations in such broad areas as satellite formation flying, cooperative unmanned 
air vehicles, and air traffic control, to name just a few. In [43], a simple model 
is proposed for phase transition of a group of self-driven particles with numerical 
demonstration of the complexity of the model. In [11], it provides a theoretical 
explanation for the behavior observed in [43] by using graph theory. In [22], a 
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general framework of the consensus problem for networks of dynamic agents with 
fixed or switching topologies is addressed. The conditions given by [22] are fur- 
ther relaxed in [26]. In [8] and [9], tracking control for multi-agent consensus with 
an active leader is considered, where a local controller is designed together with a 
neighbor-based state-estimation rule. Some predictive mechanisms are introduced 
in [47] to achieve ultrafast consensus. In [14, 17], the Hoc consensus and control 
problems for networks of agents with external disturbances and model uncertain- 
ties are investigated. The consensus problems of networks of double-integrator or 
high-order integrator agents are studied in [18, 28, 29, 36, 40, 45]. A distributed 
algorithm is proposed in [3] to asymptotically achieve consensus in finite time. The 
so-called e-consensus problem is considered in [1] for networks of dynamic agents 
with unknown but bounded disturbances. The average agreement problem is ex- 
amined in [7] for a network of integrators with quantized links. The controlled 
agreement problem of multi-agent networks is investigated from a graph-theoretic 
perspective in [31]. Flocking algorithms are investigated in [23, 38, 39] for a group 
of autonomous agents. Another topic that is closely related to the consensus of 
multi-agent systems is the synchronization of coupled nonlinear oscillators, which 
has been extensively studied, e.g., in [2, 4, 5, 19, 25, 46]. For a relatively complete 
coverage of the literatures on consensus, readers are referred to the recent surveys 
[24, 27]. In most existing studies on consensus, the agent dynamics are restricted to 
be first-, second-, and sometimes high-order integrators, and the proposed consensus 
protocols are based on the relative states between neighboring agents. 

This paper considers the consensus of discrete-time linear multi-agent systems 
with directed communication topologies. Previous studies along this line include 
[15, 16, 20, 32, 34, 41, 42, 44]. In [20, 41, 42, 44], static consensus protocols based 
on relative states of neighboring agents are used. The discrete-time protocol in [32] 
requires the absolute output measurement of each agent to be available, which is 
impractical in many cases, e.g., the deep-space formation flying [37]. Contrary to 
the protocol in [32], an observer- type consensus protocol is proposed here, based 
only on relative output measurements of neighboring agents, which contains the 
static consensus protocol developed in [41] as a special case. The observer-type 
protocol proposed here can be seen as an extension of the traditional observer-based 
controller for a single system to one for the multi-agent systems. The Separation 
Principle of the traditional observer-based controllers still holds in the multi-agent 
setting presented in this paper. 

More precisely, a decomposition approach is utilized here to convert the consensus 
of a multi-agent system, whose communication topology has a spanning tree, into 
the stability of a set of matrices with the same dimension as a single agent. The 
final consensus value reached by the agents is derived. Inspired by the notion of 
continuous-time consensus region introduced in [15] and the synchronized regions of 
complex networks studied in [4, 19, 25], the notion of discrete-time consensus region 
is introduced and analyzed. It is pointed out through numerical examples that the 
consensus protocol should have a reasonably large bounded consensus region so as 
to be robust to variations of the communication topology. For the special case where 
the state matrix is neutrally stable, it is shown that there exists an observer-type 
protocol with a bounded consensus region in the form of an open unit disk, if each 
agent is stabilizable and detectable. An algorithm is further presented to construct 
a protocol to achieve consensus with respect to all the communication topologies 
containing a spanning tree. The main result in [41] can be thereby easily obtained 
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as a corollary. On the contrary, for the general case where the state matrix is 
unstable, an algorithm is proposed to construct a protocol with the origin-centered 
disk of radius (5 (0 < (5 < 1) as its consensus region. It is pointed out that S has to 
further satisfy a constraint relying on the unstable eigenvalues of the state matrix 
for the case where each agent has a least one eigenvalue outside the unit circle, 
which shows that the consensus problem of the discrete-time multi-agent systems is 
generally more difficult to solve, compared to the continuous-time case in [15, 16]. 

In the final, the consensus algorithms are modified to solve formation control 
problems of multi-agent systems. Previous related works include [6, 13, 30]. In 
[6], a Nyquist-type criterion is presented to analyze the formation stability. The 
agent dynamics in [13, 30] are second-order integrators. In this paper, a sufficient 
condition is given for the existence of a distributed protocol to achieve a specified 
formation structure for the multi-agent network, which generalizes the results in 
[13, 30]. Such a protocol can be constructed via the algorithms proposed as above. 

The rest of this paper is organized as follows. Notations and some useful results 
of the graph theory is reviewed in Section 2. The notion of discrete-time consensus 
region is introduced and analyzed in Section 3. The special case where the state 
matrix is neutrally stable is considered in Section 4. The case where the state matrix 
is unstable is investigated in Section 5. The consensus algorithms are applied to 
formation control of multi-agent systems in Section 6. Section 7 concludes the 
paper. 

2. Notations and Preliminaries. Let R"^" and C"^" be the sets of n x n real 
matrices and complex matrices, respectively. Matrices, if not explicitly stated, have 
compatible dimensions in all settings. The superscript T means transpose for real 
matrices and H means conjugate transpose for complex matrices. || • || denotes 
the induced 2-norm. Ipf represents the identity matrix of dimension N, and / the 
identity matrix of an appropriate dimension. Let 1 £ R^* denote the vector with 
all entries equal to one. For ( G C, Re(C) denotes its real part. A(E) B denotes the 
Kronecker product of matrices A and B. The matrix inequality A > B means that 
A and B are square Hermitian matrices and A — B is positive definite. A matrix 
A G C"^" is neutrally stable in the discrete-time sense if it has no eigenvalue with 
magnitude larger than 1 and the Jordan block corresponding to any eigenvalue 
with unit magnitude is of size one, while is Schur stable if all of its eigenvalues have 
magnitude less than 1. A matrix Q G R"^" is orthogonal if QQ^ = Q^Q = I. 
Matrix P £ R"X" jg an orthogonal projection onto the subspacc range(P) if = P 
and P^ = P. Moreover, range(A) denotes the column space of matrix A, i.e, the 
span of its column vectors. 

A directed graph C/ is a pair (V,f ), where V is a nonempty finite set of nodes 
and f C V X V is a set of edges, in which an edge is represented by an ordered pair 
of distinct nodes. For an edge node i is called the parent node, j the child 

node, and j is neighboring to i. A graph with the property that G £ implies 
(j, i) € £ is said to be undirected; otherwise, directed. A path on Q from node ii 
to node ii is a sequence of ordered edges of the form (ik, ik+i), k = 1, ■ ■ ■ ,1 — 1. A 
directed graph has or contains a directed spanning tree if there exists a node called 
root such that there exists a directed path from this node to every other node in 
the graph. 

For a graph Q with m nodes, the row-stochastic matrix V G R'"^™ is defined 
with da > 0, dij > if (j, i) G £ but otherwise, and X^Jli ^ij ~ 1- According to 
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[26], all of the eigenvalues of V are either in the open unit disk or equal to 1, and 
furthermore, 1 is a simple eigenvalue of T) if and only if graph Q contains a directed 
spanning tree. For an undirected graph, 2? is symmetric. 

Let Tra denote the set of all directed graphs with m nodes such that each graph 
contains a directed spanning tree, and let T<s (0 < (5 < 1) denote the set of all 
directed graphs containing a directed spanning tree, whose non-one eigenvalues lie 
in the disk of radius 5 centered at the origin. 

2.1. Problem Formulation. Consider a network of N identical agent with linear 
or linearized dynamics in the discrete-time setting, where the dynamics of the z-th 
agent are described by 

xf = Axi + Bui, 
Hi = Cxi, i = 1,2, • • • ,N, 

where xi = Xi{k) = [xi^i, • • • , Xi^n] € R"^" is the state, xf = Xi[k + 1) is the state 
at the next time instant, Ui g is the control input, yi € R"^ is the measured 
output, and A, B, C are constant matrices with compatible dimensions. 

The communication topology among agents is represented by a directed graph 
G = (V, £), where V = {1, • • • , A^} is the set of nodes (i.e., agents) and £ C V x V is 
the set of edges. An edge (i, j) in graph Q means that agent j can obtain information 
from agent i, but not conversely. 

At each time instant, the information available to agent i is the relative mea- 
surements of other agents with respect to itself, given by 

N 

(2) 

where 2? = {dii)NxN is the row-stochastic matrix associated with graph Q. A 
distributed observer-type consensus protocol is proposed as 



TV 



v+ = iA + BK)v, + ^\ J2 - - ' 

Ui = Kv,,, 



(3) 



where Vi e R" is the protocol state, i = I,-- - ,N, L G R'^" and K e Rp^ 
are feedback gain matrices to be determined. In (3), the term d,ijC{vi — vj) 

denotes the information exchanges between the protocol of agent i and those of 
its neighboring agents. It is observed that the protocol (3) maintains the same 
communication topology as the agents in (1). 

Let Zi = [xf , vf]"^ and z = [zf , • • • , z^]"^. Then, the closed- loop system resulting 
from (1) and (3) can be written as 

z+ ^{lN®A+{lN-''D)(»n)z, (4) 



where 



A 



A BK 
A + BK 



n = 





-LC LC 



Definition 2.1. Given agents (1), the protocol (3) is said to solve the consensus 
problem if 

\\xi{k) - Xj(fc)|l 0, as fc ^ oo, V i, j = 1,2, • • • , A^. (5) 
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The following presents a decomposition approach to the consensus problem of 
network (4). 

Theorem 2.2. For any Q e Fat, the agents in (1) reach consensus under protocol 
(3) if all the matrices A + BK , A + (1 — \i)LC , i = 2, • • • , N , are Schur stable, 
where Xi, i — 2, ■ ■ ■ , N, denote the eigenvalues ofD located in the open unit disk. 

Proof. For any Q € F^v , it is known that is a simple eigenvalue oi Ij^ —T) and the 
other eigenvalues lie in the open unit disk centered at 1 + iO in the complex plane, 
where i = ^/—\. Let r"^ S ^ ^ be the left eigenvector oi Ijy ~ V associated with 



the eigenvalue 0, satisfying r 1 = 1. Introduce ^ S R- 



2Nnx2Nn 



by 



(6) 



z{t) - {{Ir' ) ® hn) z{t) 
= {(In -lr^)®l2n)z{t), 

which satisfies (r-^ (g) /2n)C = 0. It is easy to see that is a simple eigenvalue of 
/at — Ir-^ with 1 as its right eigenvector, and 1 is another eigenvalue with multiplicity 
— 1. Thus, it follows from (6) that ^ = if and only if zi = ^2 = • • • = ^w, i-e., 
the consensus problem can be cast into the Schur stability of vector ^, which evolves 
according to the following dynamics: 

t = {lN®A+{I-V)®n)S,. (7) 

Next, let Y e R^x(^-i), W e r(^-i)x^^, T e R^x^, and upper-triangular 
A e R(w-i)x(w-i) be such that 



T = [1 r] , T- 



r 

W 



T-^{In -V)T = J 



(8) 



v. Introduce 
Then, (7) can 



(9) 



(10) 



where the diagonal entries of A are the nonzero eigenvalues of In 
the state transformation C, = [T"^ ® hn)^, with ^ 
be represented in terms of ( as follows: 

C+ ^{In<E)A + J(E}'H)C 
As to Ci, it can be seen from (6) that 

Ci = (r^ ® hn)^ = 0. 

Note that the elements of the state matrix of (9) are either block diagonal or block 
upper-triangular. Hence, i — 2, • • • , A*", converge asymptotically to zero if and 
only if the iV — 1 subsystems along the diagonal, i.e., 

C+ = M+(1-A,)H)C„ i = 2,...,iV, (11) 

are Schur stable. It is easy to verify that matrices A + XiH are similar to 

'A+{l-Xi)LC 
-il-X,)LC A + BK 

Therefore, the Schur stability of the matrices A+BK, A + {l — Xi)LC, i = 2, - ■ ■ ,N, 
is equivalent to that the state C of (7) converges asymptotically to zero, implying 
that consensus is achieved. □ 

Remark 1. The importance of this theorem lies in that it converts the consensus 
problem of a large-scale therefore very high-dimensional multi-agent network under 
the observer-type protocol (3) to the stability of a set of matrices with the same 
dimension as a single agent, thereby significantly reducing the computational com- 
plexity. The directed communication topology Q is only assumed to have a directed 



2,' 
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spanning tree. The effects of the communication topology on the consensus problem 
arc characterized by the eigenvalues of the corresponding row-stochastic matrix 2?, 
which may be complex, rendering the matrices be complex-valued in Theorem 2.2. 

Remark 2. The observer-type consensus protocol (3) can be seen as an extension of 
the traditional observer-based controller for a single system to one for multi-agent 
systems. The Separation Principle of the traditional observer-based controllers 
still holds in this multi-agent setting. Moreover, the protocol (3) is based only on 
relative output measurements between neighboring agents, which can be regarded 
as the discrete-time counterpart of the protocol proposed in [15, 16], including the 
static protocol used in [41] as a special case. 

Theorem 2.3. Consider the multi-agent network (4) with a communication topol- 
ogy ^ G Fat. If protocol (3) satisfies Theorem 2.2, then 

(12) 

Vi{k) {), i = 1,2, - ■ ■ ,N, as k ^ oo, 

where r £ satisfies r^ {1^ — I?) = and r'^l = 1. 
Proof. The solution of (4) can be obtained as 

z{k + 1) = {In®A+ {In -V)® nf z(0) 

= {T (g) I){In (g) A+ J (E>H)''iT-^ (g> l)z{0) 

(T-i ®/)z(0), 

where matrices T, J and A are defined in (8). By Theorem 2.2, In-i g) A-\- Ag)T-L 
is Schur stable. Thus, 

z{k + 1)^(1® I)A''ir^ ® l)z{0) 

= {Ir'^) ® A''z{0), asfc->oo, 

implying that 

z^{k) ^ {r^ g)A'')z{0), asfc^oo, i = 1,--- ,iV. (13) 
Since A + BK is Schur stable, (13) directly leads to the assertion. □ 

Remark 3. Some observations on the final consensus value in (12) can be concluded 
as follows: If A is Schur stable, then w{k) — )■ 0, as fc — )■ oo. If A in (1) has eigenvalues 
located outside the open unit circle, then the consensus value w{k) reached by the 
agents will tend to infinity exponentially. On the other hand, if A has eigenvalues in 
the closed unit circle, then the agents in (1) may reach consensus nontrivially. That 
is, some states of each agent might approach a common nonzero value. Typical 
examples belonging to the last case include the commonly-studied first-, second-, 
and high-order integrators. 



Xi{k) — > wik) = (r"^ 



xi(0) 



Xiv(O) 



(T® /) 



A'' 
[In-i® A + /:^®nf 
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3. Discrete-Time Consensus Regions. From Theorem (2.2), it can be noticed 
that the consensus of the given agents (1) under protocol (3) depends on the feed- 
back gain matrices K , L, and the eigenvalues Ai of matrix V associated with the 
communication graph Q, where matrix L is coupled with Xi, i = 2, ■ ■ ■ ^ N . Hence, 
it is useful to analyze the correlated effects of matrix L and graph Q on consensus. 
To this end, the notion of consensus region is introduced. 

Definition 2. Assume that matrix K has been designed such that A + BK is Schur 
stable. The region S of the parameter ct C C, such that matrix A + {I ~ a)LC is 
Schur stable, is called the (discrete-time) consensus region of network (4). 

The notion of discrete-time consensus region is inspired by the continuous-time 
consensus region introduced in [15] and the synchronized regions of complex net- 
works studied in [4, 19, 25]. The following result is a direct consequence of Theorem 
2.2. 



Corollary 1. The agents in (1) reach consensus under protocol (3) if Xi € S, 
i = 2, - ■ ■ , N , where Xi, i = 2, - ■ ■ , N , are the eigenvalues of T) located in the open 
unit disk. 

For an undirected communication graph, the consensus region of network (4) 
is a bounded interval or a union of several intervals on the real axis. However, 
for a directed graph where the eigenvalues of V are generally complex numbers, the 
consensus region S is either a bounded region or a set of several disconnected regions 
in the complex plane. Due to the fact that the eigenvalues of the row-stochastic 
matrix 2? lie in the unit disk, unbounded consensus regions, desirable for consensus 
in the continuous-time setting [15, 16], generally do not exist for the discrete-time 
consensus considered here. 

The following example has a disconnected consensus region. 
Example 1. The agent dynamics and the consensus protocol are given by (1) and 
(3), respectively, with 



A = 
L = 



1 
-1 1.02 



B = 



C = 



1 
1 



-1 





, -ft: =[-0.5 -0.5] 



Clearly, matrix A + BK with K given as above is Schur stable. For simplicity in 
illustration, assume that the communication graph Q is undirected here. Then, the 
consensus region is a set of intervals on the real axis. The characteristic equation 
of A+{l-a)LC is 



det(z/ - A - (jLC) = z"^ - l.G2z + =0. 
Applying bilinear transformation z = to (14) gives 

(cr^ - 0.02)5^ + (1 - cr^)s + 2.02 + cr^ = 0. 



(14) 



(15) 



It is well known that, under the bilinear transformation, (14) has all roots within 
the unit disk if and only if the roots of (15) lie in the open left-half plane (LHP). 
According to the Hurwitz criterion [21], (15) has all roots in the open LHP if 
and only if 0.02 < cr^ < 1. Therefore, the consensus region in this case is 5 = 
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(— 1, —0.1414) U (0.1414, 1), a union of two disconnected intervals. For the commu- 
nication graph shown in Figure 1, the corresponding row-stochastic matrix is 



0.3 


0.2 


0.2 


0.2 





0.1 


0.2 


0.6 


0.2 











0.2 


0.2 


0.6 











0.2 








0.4 


0.4 














0.4 


0.2 


0.4 


0.1 











0.4 


0.5 



whose eigenvalues, other than 1, are -0.2935, 0.164, 0.4, 0.4624, 0.868, which aU be- 
long to S. Thus, it follows from Corollary 1 that network (4) with graph given in 
Figure 1 can achieve consensus. 



0-^ ^© 




Figure 1 . The communication topology. 



Let's see how modifications of the communication topology affect the consensus. 
Consider the following two simple cases: 

1) An edge is added between nodes 1 and 5, thus more information exchange will 
exist inside the network. Then, the row-stochastic matrix T) becomes 



0.2 


0.2 


0.2 


0.2 


0.1 


0.1 


0.2 


0.6 


0.2 











0.2 


0.2 


0.6 











0.2 








0.4 


0.4 





0.1 








0.4 


0.2 


0.3 


0.1 











0.4 


0.5 



whose eigenvalues, in addition to 1, are -0.2346,0.0352,0.4,0.4634,0.836. Clearly, 
the eigenvalue 0.0352 does not belong to 5, i.e., consensus can not be achieved in 
this case. 

2) The edge between nodes 5 and 6 is removed. The row-stochastic matrix V 
becomes 



0.3 


0.2 


0.2 


0.2 





0.1 


0.2 


0.6 


0.2 











0.2 


0.2 


0.6 











0.2 








0.4 


0.4 





0.1 








0.4 


0.6 





0.1 














0.9 
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whose eigenvalues, other than 1, are -0.0315,0.2587,0.4,0.8676,0.9052. In this 
case, the eigenvalue —0.0315 does not belong to S, i.e., consensus can not be 
achieved cither. 

These sample cases imply that, for disconnected consensus regions, consensus can 
be quite fragile to the variations of the network's communication topology. Hence, 
the consensus protocol should be designed to have a sufficiently large bounded 
consensus region in order to be robust with respect to the communication topology. 
This is the topic of the following sections. 

4. Networks with Neurally Stable Agents. In this section, a special case where 
matrix A is neutrally stable is considered. First, the following lemma is needed. 

Lemma 4.1 ([48]). For matrix Q = G Qnxn ^ consider the following Lyapunov 
equation: 

A"XA - X + Q^0. 
If X > 0, Q > 0, and (Q, V) is observable, then matrix A is Schur stable . 

Proposition 1. For matrices Q € R"^", V £ R™^", cr e C, where Q is orthogo- 
nal, VV'^ = I, and {Q,V) is observable, if\a\ < 1, then the matrix Q^{1—(t)QV^V 
is Schur stable. 

Proof. Observe that 

(Q - (1 - a)QV^V)"{Q - (1 - a)QV^V) - I 

= g^g - (1 - a)Q^QV^V - (1 - a)V^VQ'^Q 

+ \l-a\'^V^VQ^QV^V -I (16) 

= (-2Re(l - cr) + |1 - (j\^)V'^V 

= i\a\'-l)V^V. 

Since (g, V) is observable, it is easy to verify that (g — (1 — it)QV^V, V'^V) is 
also observable. Then, by Lemma 4.1, (16) implies that g — (1 — a)QV^V is Schur 
stable for any |cr| < 1. □ 

Next, an algorithm for protocol (3) is presented, which will be used later. 
Algorithm 1. Given that A is neutrally stable and that {A,B,C) is stabilizable 
and detectable, the protocol (3) can be constructed as follows: 

1) Select K be such that A + BK is Schur stable. 

2) Choose U G R"X"i and W e R"x("-"i), satisfying ^ 

'M 0" 
X ' 



[U W] ^ A[U W] 



(17) 



where M G R"ix«i is orthogonal and X e R(»-"i)x("-"i) is Schur stable. 

3) Choose V e R™x"i ^^^^^ ^j^j^^ yyT ^ range(y^) = rangc(;7^C'^). 

4) Define L = -U MV^ [CUV^)-^ . 

Theorem 4.2. Suppose that matrix A is neutrally stable and that (A, B, C) is 
stabilizable and detectable. The protocol (3) constructed via Algorithm 1 has the 
open unit disk as its bounded consensus region. Thus, such a protocol solves the 
consensus problem for (1) with respect to Tn, the set of all the communication 
topologies containing a spanning tree. 



^Matrices U and W can be derived by transforming matrix A into the real Jordan canonical 
form [10]. 
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Proof. Let the related variables be defined as in Algorithm 1. Assume without loss of 
generality that matrix CU is of full row rank. Since V'^V is an orthogonal projection 
onto range(y-^) = range(C/'^C"^), matrix CUV^ is invertible and V'^VU'^C'^ = 
U'^C^, so that V = {CUV'^y'^CU, and hence LCU = -UMV'^V. Also, the 
detectabihty of (A, C) implies that {M,V) is observable. Let W e R»iX" and 



WW = 0, and W^U = 0. Then 

[U U] 
\M- 



[[/ , where U'^U = /, W'^W = /, 



(A+(1-(t)LC) [C/ 
\-g)U'^LC\J (1 



(1 - cr)iyt7^cc/ a: 

M-(l-cr)My^y -(1 




- cr)WLCW 

(1 - a)W''LCW 

- (t)WLCW' 

X 



(18) 



By Lemma 4.1, matrix Af — (1 — a)MV^V is Schur stable for any \cr\ < 1. Hence, 
(18) implies that matrix ^ + (1 — a)LC with L given by Algorithm 1 is Schur 
stable for any \cr\ < 1, i.e., the protocol (3) constructed via Algorithm 1 has a 
bounded consensus region in the form of the open unit disk. Since the eigenvalues 
of any communication topology containing a spanning tree lie in the open unit 
disk, except eigenvalue 1, it follows from Corollary 1 that this protocol solves the 
consensus problem with respect to T^. □ 



In [41], the consensus of the following coupled network is considered: 

N 

xf = Axi + LC ^^dij{xi - Xj), i = 1,2 - ■ ■ , N, 



(19) 



where {dij)NxN is defined as in (2) and matrix L is to be designed. 
The main result of [41] can be easily obtained as a corollary here. 

Corollary 2. There exists a matrix L such that network (19) has the open unit 
disk as its consensus region, i.e., the network can reach consensus with respect to 
Fat, if and only if the pair {A, C) is detectable. Such a matrix L can he constructed 
via Algorithm 1. 

Proof. For any communication topology G F^r, it follows from Theorem 2.2 that 
there exists a matrix L such that network (19) achieves consensus if and only if 
matrices A + (1 — Xi)LC, i = 2, • • • ,N, are Schur stable. The necessity is obvious 
and the sufficiency follows readily from Theorem 4.2. □ 

Remark 4. Compared to Theorem 6 in [41], the above corollary presents a neces- 
sary and sufficient condition for the existence of a matrix L that ensures the network 
to reach consensus. Moreover, the method leading to this corollary is quite different 
from and comparatively much simpler than that used in [41]. Of course, it should 
be admitted that the proof of Theorem 4.2 above is partly inspired by [41]. 

Example 2. Consider a network of agents described by (1), with 



C = [1 1] 





' 0.2 


0.6 







"0" 


A^ 


-1.4 


0.8 





, B = 


1 




0.7 


0.2 


-0.5 
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The eigenvalues of matrix A are —0.5, 0.5 ± iO.866, thus A is neutrally stable. In 
protocol (3), choose K = [l.2 -0.9 -0.2] such that A + BK is Schur stable. 
The matrices 





" 0.1709 


-0.4935" 




"o" 


u = 


0.7977 












-0.0570 


-0.2961 




1 



satisfy (17) with A/ = [.^igg Vf] andX = -0.5. Thus, f/^C^ = [0.1139 -0.7896]^. 
Take V = [0.1428 -0.9898] such that VV'^ = 1 and range(y^) = range(C/^C^). 

Then, by Algorithm 1, one obtains L = [-0.2143 0.7857 -0.2857]^. In light of 
Theorem 4.2, the agents considered in this example will reach consensus under the 
protocol (3), with K and L given as above, with respect to all the communication 
topologies containing a spanning tree. 



5. Networks with Unstable Agents. This section considers the general case 
where matrix A is not neutrally stable, i.e., A is allowed to have eigenvalues outside 
the unit circle or has at least one eigenvalue with unit magnitude whose correspond- 
ing Jordan block is of size larger than 1. 

Before moving forward, one introduces the following modified algebraic Riccati 
equation (MARE) [12, 33, 35]: 

P = APA^ - (1 - S^)APC^iCPC^ + ly^CPA^ + Q, (20) 

where P > 0, Q > 0, and (5 e R. For S ^ 0, the MARE (20) is reduced to the 
commonly- used discrete-time Riccati equation discussed in, e.g., [48]. 
The following lemma concerns the existence of solutions for the MARE. 

Lemma 5.1 ([33, 35]). Let (A, C) be detectable. Then, the following statements 
hold. 

a) Suppose that the matrix A has no eigenvalues with magnitude larger than 
1, Then, the MARE (20) has a unique positive- definite solution P for any 
Q<5 <l. 

b) For the case where A has a least one eigenvalue with magnitude larger than 
1 and the rank of B is one, the MARE (20) has a unique positive- definite 
solution P, if < S < np^ir^^; where A" (A) denote the unstable eigenvalues 

of A. 

c) If the MARE (20) has a unique positive-definite solution P, then P = limfc_i.oo Pk 
for any initial condition Pq > 0, where Pk satisfies 

P{k + 1) = AP{k)A^ - (1 - S^)AP{k)C^{CPik)C^ + I)-^CP{k)A^ + Q. 

Proposition 2. Suppose that (A, C) be detectable. Then, for the case where A 
has no eigenvalues with magnitude larger than 1, the matrix A + (1 — a)LC with 
L = -APC'^iCPC'^ + 1)-^ is Schur stable for any \a\<S,0 <S <l, where P>0 
is the unique solution to the MARE (20). Moreover, for the case where A has at 
least eigenvalue with magnitude larger than 1 and B is of rank one, ^1 + (1 — a)LC 
with L = -APC'^iCPC^ + /)-! IS Schur stable for any \a\ <S,0<d < yhx^aM - 
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Proof. Observe that 

(A + (1 - (j)LC)P{A + (1 - (t)LC)" - P 

^ APA^ - 2Re(l - a)APC^iCPC^ + ly^CPA^ - P 

+ |1 - a\^APC'^{CPC'^ + ly^CPC'^iCPC'^ + ly^CPA^ 
= APA^ + (-2Re(l - cr) + |1 - a\^)APC'^ [CPC'^ + ly^CPA^ - P 

+ |1 - a\'^APC'^{CPC'^ + (-/ + CPC^iCPC^ + I)'^) CPA^ (21) 
= APA^ + (|cr|2 - l)APC^{CPC'^ + ly^CPA^ - P 

- |1 - afAPC^iCPC'^ + ly'^CPA^ 
< APA^ - (1 - S^)APC'^{CPC'^ + ly^CPA^ - P 

= -Q<o, 

where the identity -I + CPC^{CPC^ + 1)-^ = -{CPC^ + iy^ has been applied. 
Then, the assertion follows directly from Lemma 5.1 and the discrete-time Lyapunov 
inequality. □ 

Algorithm 2. Assuming that (A, B, C) is stabilizable and detectable, the protocol 
(3) can the constructed as follows: 

1) Select K such that A + BK is Schur stable. 

2) Choose L = -APC'^{CPC^ + /)"\ where P > is the unique solution of 
(20). 

Remark 5. By Lemma 5.1 and Proposition 2, it follows that a sufficient and nec- 
essary condition for the existence of the consensus protocol by using Algorithm 2 is 
that (A, _B, C) is stabilizable and detectable for the case where A has no eigenvalues 
with magnitude larger than 1. In contrast, 5 has to further satisfy 5 < n|A"(A)| 

the case where A has at least eigenvalue outside the unit circle and B is of rank 
one. 



The result below follows directly from Theorem 2.3 and Proposition 2. 



Theorem 5.2. Let [A, B, C) he stabilizable and detectable. Then, the protocol given 
by Algorithm 2 has a hounded consensus region in the form of an origin- centered 
disk of radius 5, i.e., this protocol solves the consensus problem for networks with 
agents (1) with respect to V<,s, where 5 satisfies < S < 1 for the case where A 



has no eigenvalues with magnitude larger than 1 and satisfies < (5 < 



for 



the case where A has a least one eigenvalue outside the unit circle and B is of rank 
one. 

Remark 6. Note that T<s was defined in Section 2, which is a subset of Tm 
in the special case where A is neutrally stable as discussed in the above section. 
This is consistent with the intuition that unstable behaviors are more difficult to 
synchronize than the neutrally stable ones. 

Example 3. Let the agents in (1) be discrete-time double integrators, with 



A 



1 1 
1 



B 



C=[l 0] 
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Obviously, Assumption 1 holds here. Choose K = [—0.5 
A + BK is Schur stable. Solving equation (20) with 5 - 

1.1780 0.0602 Algorithm 2, one obtains L ^ [-1.051 -0.051] 



— 1.5], so that matrix 
0.95 gives P = 10^ x 



It follows 



0.0602 0.0062 

from Theorem 5.2 that the agents (1) reach consensus under protocol (3) with K 
and L given as above with respect to r<o.95. Assume that the communication 
topology Q is given as in Figure 2, and the corresponding row-stochastic matrix is 



0.4 
0.5 
0.3 
0.5 








0.5 
0.2 










0.5 







0.1 




0.5 
0.4 





0.3 





0.4 
0.3 



0.2 





0.2 
0.7 



whose eigenvalues, other than 1, are A,; = 0.5, 0.5565, 0.2217 ± iO. 2531. Clearly, 
I Ail < 0.95, for i = 2, • • • ,6. Figure 3 depicts the state trajectories of network (4) 
for this example, which shows that consensus is actually achieved. 




Figure 2. The communication topology. 



6. Application to Formation Control. In this section, the consensus algorithms 
are modified to solve formation control problems of multi-agent systems. 

Let H = {hi,h2,--- ,/iAr) G R"^^ describe a constant formation structure of 
the agent network in a reference coordinate frame, where hi S R", is the formation 
variable corresponding to agent i. For example, hi = [O O] , /i2 = [O l] , 

/13 = [l O]"^, and /i4 = [1 1]"^ represent a unit square. Variable hi — hj denotes 
the relative formation vector between agents i and j, which is independent of the 
reference coordinate. 

A distributed formation protocol is proposed as 

/n 

v+ = {A + BK)v, + L I ^ dyC(w, -vj)- Q 
Ui = Kvi, 
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Figure 3. The state trajectories of a double- integrator network. 



where Ci = d^ijiUi ^ Vj ^ C{hi — hj)) and the rest of variables are the same 

as in (3). It should be noted that (22) reduces to the consensus protocol (3), when 
h, - hj = 0, Vi, j = 1,2, • • • ,iV. 

Definition 6.1. The agents (1) under protocol (22) achieve a given formation 

H = (/li,/l2,--- ,/lAr) if 

\\x^{k) - hi - Xj{k) + hj\\ ^0, as A: ^ oo, V i, j = 1, 2, • • • , TV. (23) 

Theorem 6.2. For any Q G Tjsi, the agents (1) reach the formation H under 
protocol (22) if all the matrices A + BK, A + {1- Xi)LC, i = 2, • • • ,N, are Schur 
stable, and {A — I){hi — /ij) = 0, Vi, j = 1, 2, • • • , N , where Xi, i — 2, ■ ■ ■ , N , denote 
the eigenvalues ofD located in the open unit disk. 

Proof. Let e^; = Xi — hi — xi + hi and e^,. = Vi — vi, i ~ 2, ■ ■ ■ , N. Then, the agents 
(1) can reach the formation H if and only if CxXk) — > 0, as fc — > oo, Vi = 2, • • • ,N. 
By invoking {A - I){h, - h^) = 0, ij = 1, 2, • • • , TV, it follows from (1) and (22) 
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that 



{A + BK)e^^ +LC I ^d,j(e 



N 



Vi ^v- 



N 



N 



N 
3=2 



dijie^i - ex, ) + ^ dxjGxj , i = 2, • • • , iV. 



J=2 



J=2 



Let Ci = [e^. , e^.]"^, i = 2, • • • , A^, and e = [ej, • • • , e^]^. Then, one has 

e+ = (/tv-i (g) ^ + {In-\ - X>2 + l7V-ia) ® e, 
where matrices H are defined in (4), and 



(24) 





rfl2 


di3 • • 


dlTv] , 




C^22 


^23 


d\N 




dzi 


^33 


dsN 


7?2 = 










d-Ni 


rfAr3 


dNN 



By tlie definition of matrix V, one can obtain [20] 

"0 a 



witli S = 



1 



Therefore, the nonzero eigenvalues of /^r — 2? are all 





the eigenvalues of In-i — f 2 + Iw-io;. By following similar steps in the Proof of 
Theorem 2.2, one gets that system (24) is asymptotically stable if and only if all the 
matrices A + BK, A + {1 — Xi)LC, i = 2, - ■ ■ ,N, are Schur stable. This completes 
the proof. □ 

Remark 7. Note that all kinds of formation structure can not be achieved for 
the agents (1) by using protocol (22). The achievable formation structures have 
to satisfy the constraints (A — I){hi — hj) = 0, Vi, j = 1, 2, • • • ,N. The formation 
protocol (22) for a given achievable formation structure can be constructed by using 
Algorithms 1 and 2. Theorem 6.2 generalizes the results given in [13, 30], where the 
agent dynamics in [13, 30] are restricted to be (generalized) second-order integrators. 

Example 4. Consider a network of 6 double integrators, described by 

X,^ ^" ; 

Vi — ^ — 1; 2, • • • , 6, 

where Xi G R^, Vi G R^, yi G R^, and Ui G R^ arc the position, the velocity, the 
measured output, and the acceleration input of agent z, respectively. 

The objective is to design a protocol (22) such that the agents will evolve to a 
regular hexagon with edge length 8. In this case, choose /ii = [O O]^, 
ho = 



0]^ 



[12 4\/3 0] , /14 = [8 8\/3 0]' 



[0 8^3 0] , /i6 [-4 4V3 0] . As in Example 3, take K = [-O.5/2 
-1.5/2] and L = [-I.O5I/2 -0.051/2]^ in protocol (22). Then, the agents with 
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such a protocol (22) will form a regular hexagon with respect to r<o.95. The sate 
trajectories of the 6 agents are depicted in Figure 4 for the communication topology 
given in Figure 2. 



7. Conclusions. This paper has studied the consensus of discrete-time multi-agent 
systems with linear or linearized dynamics. An observer-type protocol based on the 
relative outputs of neighboring agents has been proposed, which can be seen as 
an extension of the traditional observer-based controller for a single system to one 
for multi-agent systems. The consensus of high-dimensional multi-agent systems 
with directed communication topologies can be converted into the stability of a set 
of matrices with the same low dimension as that of a single agent. The notion 
of discrete-time consensus region has been introduced and analyzed. For neurally 
stable agents, an algorithm has been presented to construct a protocol having a 
bounded consensus region in the form of the open unit disk. Moreover, for unstable 
agents, another algorithm has also been proposed to construct a protocol having an 
origin-centered disk of radius 5 (0 < (5 < 1) as its consensus region. The consensus 
algorithms have been further applied to solve formation control problems of multi- 
agent systems. To some extent, this paper generalizes some existing results reported 
in the literature, and opens up a new line for further research on discrete-time multi- 
agent systems. 
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